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Abstract 

In this paper, we prove a Morse index theorem for the index form of regular Lagrangian 
system with selfadjoint boundary condition. 

1 Introduction 

Let (M, g) be an n-dimensional Riemannian manifold. The classical Morse Index Theorem 
states that the number of conjugate points along a geodesic 7 : [a, b] — > M counted with 
multiplicities is equal to the index of the second variation of the Riemannian action functional 
E(c) = \ fa g{c, c)dt at the critical point 7, where c denotes 4rc. Such second variation is called 
the index form for E at 7. The theorem has later been extended in several directions (see 
0, g g, [R| [20j, [21| for versions of this theorem in different contexts). In g of 1976, J. 



J. Duistermaat proved his general Morse index theorm for positive definite Lagrangian system 
with selfadjoint boundary conditions. In [ffl] of 1996, A. A. Agrachev and A. V. Sarychev studied 



the Morse index and rigidity of the abnormal sub-Riemannian geodesies. In [16, 18] of 2000, 
P. Piccione and D. V. Tausk proved a version of the Morse index theorem for geodesies in 
semi-Riemannian geodesies with both endpoints varies on two submanifolds of M under some 
nondegenerate conditions (cf. Theorems 5.2 and 5.9 in [|is|l). In this paper, we will prove a 
general version of Morse index theorem for regular Lagrangian system with selfadjoint boundary 
conditions, and show how the indices varies under different choices of the frames. The relation 
between the indices for two different boundary conditions is a easy corollary of Proposition 



2.4] below. In order to get such a general theorem for regular Lagrangian system, one has to 



overcome the following difficulties. 

(1) The multiplicities of conjugate points may be meaningless. 

(2) The Morse index of the index form may be infinity. 

(3) The corresponding second order operators may have different domains. 

We overcome these difficulties by using the notions of Maslov-type indices (see 0, |6[ |l2|, [U 
and the spectral flow (see ||, [|, ^, |i~9|). 
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Let M be a smooth manifold of dimension n, points in its tangent bundle TM will be denoted 
by (m, v), with m G M, v G T m M. Let / be a real- valued C 3 function on an open subset Z of 
R x TM. Then 

£(c) = f T f(t,c(t),c(t))dt (1) 
•/ o 

defines a real-valued C 2 function E on the space of curves 

C = {c G C7 1 ([0,2l,M);(t,c(t),c(t)) G Z for all t G [0,T]} . (2) 

The set C is a C 2 Banach manifold modeled on the Banach space C 1 ([0, T],R n ) with its usual 
topology of uniform convergence of the curves and their derivatives. 

Boundary conditions will be introduced by restricting E to the set of curves 

C N = {ceC;(c(0),c(T)) eN}, (3) 

where N is a given smooth submanifold of M x M. The most familiar example are N = 
{(m(0), ra(T)} and N = {(m\,m2) G M x M;m\ = m^}- In the general case Cn is a smooth 
submanifold of C with tangent space equal to 

T C C N = {5c G C\[V,Tic*TM); (5c(0),5c(T)) G r (c(0)iC(T)) iv} . (4) 

c G Cjv is called stationary curve for the boundary condition N if the restriction of E to Cn 
has a stationary point at c, that is, if DE(c)(5c) = for all 5c G T c Cn. For such a curve c is of 
class C 2 . 

Let c is of class C 2 . Then the second order differential D 2 E(c) of E at c is symmetric bilinear 
form on T c Cn, which is called the index form of E at c with respect to the boundary condition 
N. In general the Morse index of D 2 E(c) will be infinite. In order to get a well-defined integer, 
we introduce the following concept. 

Assume that / is a regular Lagrangian, that is, 

D 2 f(t, m, v) is nondegenerate for all (t, m, v) G Z. (5) 

Here D v denotes differential of functions on Z with respect to v G T m M, keeping t and m fixed. 
The condition (||) is called the Legendre condition. 

Let H = H (T c Cj\r) be the H 1 completion of T c Cn. By Sobolev embedding theorem, H C 
C([0, T], c*TM). Then D 2 E(c) is well defined on H. In local coordinates, we have 

D 2 E(c)(X,Y) = [ T ((D 2 J(c(t))d + D m DMt))aJ) 
Jo 

+{D v D m {c(t))a, [3) + (D m D m (c{t))a, (3))dt, (6) 

where X,Y G H , a, (3 are the local coordinate expression of X, Y defined by X = (a, dm), 
Y = dm), dm is the natural frame of T m M, and we have use the abbreviation 

c(t) = (t,c(t),c(t)). (7) 
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In general dm and a is not globally well-defined along c. Choosing a C 1 frame e of T c Cn- 
Such a frame can be obtained by the parallel transformation of the induced connection on 
c*TM of a connection on TM (for example, the Levi-Civita connection with respect to a semi- 
Riemannian metric on TM). Then in local coordinates, there is a C 1 path a(t) G gl(ra, R) 
which is nondegenerate for all t such that dm = (a(t), e(t)) = a(t)*e(t), where a(t)* denotes the 
transpose conjugate of a(t). The vector fields X, Y G H along c can be written as X = (x,e), 
Y = (y,e), where x,y G 2T 1 ([0, T], R n ) and (x(0), x(T)), (y(0), y(T)) G R, R is defined by Q 

22 = {(x, y) G R 2 "; ((x, e(0)), (y, e(T))) G T {c{0)AT)) N}. 

So we have 



x = aa, x = aa + da, y = a(3, y = af3 + df3. (8) 
Substitute (H) to (0), we get the following form of the the index form: 

D 2 E{c)(X, Y) = [ T ((pi + gx, y) + (g*i, y) + (rx, y)) eft, (9) 
Jo 

where p,q,r G C([0, T], gl(n, R)), p is of class C 1 , p(t) = p(t)*, r(t) = r(t)* , p(t) are invertible 
for all t G [0,T], and * denotes the conjugate transpose. Now define 

fT 

l s {x,y)= ((px + sqx,y) + {sq*x,y) + (srx,y))dt, sG[0,l], (10) 
Jo 

where x,y G 2f 1 ([0, T],R n ) and (x(0), x(T)), (y(0), y(T)) G 2?. Since p is of class C 1 and is 
nondegenerate, the relative Morse index I(Iq,Ii) = — sf{X s } is a well-defined finite integer. 
When p is positive definite, I{Tq,T{) is the Morse index of D 2 E(c) (where we only require that 
p is continuous). 

The main results in this paper is the following. 

Let p,q,r G C([0, 1] x [0, T], gl(n, C)) be families of matrices such that p is of class C 1 , 
Ps(t) = p s (t)*, r s (t) = r s (t)*, and p s (t) is invertible for all s G [0, 1] and t G [0, T\. 
Let R be a subspaces of C 2n . Let 22# be the Hilbert space defined by 

H R = {x G 22 1 ([0,T],C"); (x(0),x(T)) G r} . (11) 
For each s G [0, 1], let I s be the index form defined by 

X s (x,y)=f ((p s x + q s x,y) + (q*x,y) + (r s x,y))dt, x,y G H R . (12) 
•/ o 

Let J = ( j ^ n J , 2 ra is the identity matrix on R n . When there is no confusion we will 



Jn 

omit the subindex of identity matrices. Let 



h(t\=( Pgl ^ -P s 1 (t)q s (t) \ . , 



In this paper, all vectors are viewed as column vectors. For a pair of vectors x,y G C n , has two 

meanings: one is the standard Hermitian inner product of x,y, the other is the the vector (x*,y*)* € C 2n . The 
readers can easily see it from the content. 
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For each s G [0, 1], let 7 s (i) be the fundamental solution of the linear Hamiltonian equation 

u = Jb s (t)u. (14) 

Define 



R b = {(x,y) GC 2n ;(x,-y) e it 1 }, 
W(R) = {(x,y,z,u) eC in ;(x,-z) e R ± ,(y,u) e R}. 



Then we have 



Theorem 1.1 Let sf{Z s ; < s < 1} be the spectral flow ofI s , and iw(R){l) be the Maslov-type 
index of 7 defined below. Then we have 

- sf{J s ;0 < s < 1} = i W (R)(jl) ~ iw(R)(lo)- (15) 

Assume that qo(t) = ro(t) = for all t G [0,T]. Then we have bo(t) = diag(po x (t), 0) and 
70 W = ( rt x , for all i G [0,T]. 



/0P0 ( s ) ds 1 

Theorem 1.2 Let P G C([0, T], gl(n, C)) 6e a paf/i 0/ self adjoint matrices. Define j(t) = 

iw(R)(l) = m + (P(T)\ s ) - m+(P(0)\ s ), (16) 
where m + denotes the Morse positive index, and 

S = {xe C n ;(x,x) G R 6 }. 

As a special case, we get the following theorem of J. J. Duistermaat Q. 

Corollary 1.1 Assume that pi(t) are positive definite for all t G [0, T]. Then we have 

m~(Xi) = i W (R)(li) ~ dim c S, (17) 
where m~ denotes the Morse (negative) index, and 

S = {xeC n ;(x,x) GR 6 }. 

Let a{t) G Gl(n, C), and 

i?' = {(x, y) G C 2 "; (a(0)x, a(T)y) G i?}. 

After change of frame x 1 — ► ox, L\(ax, ay) defines a quadratic form on H R / and we can get the 
corresponding p 1; and r x . By (filf) and (PH) we get the corresponding b\ and / y[. 

Theorem 1.3 VFe have the following 

V(K')(7i) " *W(«)(7l) = dim c (Gr(J) Hi?') - dim c (Gr(J) n R), (18) 

where Gr(I) denotes the graph of I. 



The paper is organized as follows. In §2, we discuss the properties of the spectral flow. In 
§3, we discuss the properties of the Maslov-type indices. In §4, we prove our main results. 
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2 Spectral flow 

2.1 Definition of the spectral flow 

The spectral flow for a one parameter family of linear selfadjoint Fredholm operators is intro- 
duced by Atiyah-Patodi-Singer Q in their study of index theory on manifolds with boundary. 
Since then other significant applications have been found. In || the notion of the spectral 



flow was generalized to the higher dimensional case by X. Dai and W. Zhang. In [23, |24j it is 
generalized to more general operators. 

Let X be a Banach space. We denote the set of closed operators, bounded linear operators 
and compact linear operators on X by C(X), B(X) and CC(X) respectively. For A £ C(X), an 
operator B is called A-compact if D(A) C ~D(B), and view B as operator from D(A) to X, is 
compact, where D(A) is the domain of A with the graph norm of A. 

According to Atiyah-Patodi-Singer H, we define 



Definition 2.1 (cf. Definition 1.3.6 of fi2Qj and Definition 2.6 of $4]) (1) Let I be a real 
dimension 1 cooriented embedded C 1 submanifold of C without boundary. Let A be in C(X). A 
is said to be admissible with respect to I if the spectrum of A near I lies on a compact subset 
of I and is of finite algebraic multiplicity. If 00 is a limit point of I, we require A £ B(X). Let 
Pi (A) be the spectral projection of A on I. The nullity v\ {A) of A with respect to I is defined to 
be vi(A) = dime im Pi(A). All such A will be denoted by Ai(X). 

(2) Let A s , < s < 1 be a curve in Ai{X). The spectral slow sf^{A s } of A s counts 
the algebraic multiplicities of the spectral of A s cross the manifold I, i.e., the number of the 
spectral lines of A s cross I from the negative part of C near I to the non-negative part of C 
near I minus the number of the spectral lines of A s cross I from the non-negative part of C 
near I to the negative part of C near I. When I = y/ — 1(— K, K) and A s £ Ai(X) be such that 
a(A s ) n y/— 1R C y/—l(—K, K) for all s, where (—K,K) (K > 0) denotes the open interval on 
R and o~(A) denotes the spectrum of A, we set si{A s } = sii{A s }. 

(3) Let I = \J— 1R, A £ Ai(X) and B £ CC(X), or X is a Hilbert space, A is a selfadjoint 
Fredholm operator with compact resolvent and B is bounded selfadjoint operator, The relative 
Morse index of the pair A, A + B is defined by 

I(A,A + B) = -sf{A + sB}. (19) 

(4) When I = y/— 1R and A £ Ai(X), or A is selfadjoint Fredholm on Hilbert space X and 
I = y/— 1(— e, e), we call the algebraic multiplicity of the spectrum of A in the right side and the 
left side I the Morse positive index and the Morse (negative) index, and denote them by 
m + {A) and m~(A). The signature sign(A) is defined by sign(A) = m + (A) — m~(A). 
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2.2 Calculation of the spectral flow 

Let X be a complex Banach space, 7 be a C 1 curve in C which bounds a bounded open subset 
Q of C. Let A s , s S (— e, e), where e > 0, be a curve in C(X). Assume that 71"! a(A s ) = for all 
s G (— e, e), where a(A s ) denotes the spectral of A s . Set Aq = A, and 

P s = P 7 (A fl ) = -— ^ / fl(£ A fl )dC, (20) 



2W-1 
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where P(C, A fl ) = (A s - (I)' 1 , ( £ C \a(A s ) is the resolvent of A s . Then P s 2 = P s . Set P = P- 
Assume that imPc D(A S ), for all s E (— e, e), im P is a finitely dimensional subspace of X, and 
■^\ s= o(A s P) = B. Then B is bounded. Let / be a polynomial. Then P s f(A s )P s is uniformly 
bounded on any compact subsets of (— e, e), and 

P s f(A s )P s = -— != / f(()R((,A s )d(. (21) 

Set R S = (I- (P s - P) 2 )"i Then P S P = PP S and P S P S = P S R S . Set 

^ = P S P + (I - P S )(I - P), U S = U' S R S , 
V' s = PP S + (I-P)(I-P S ), V S = V' S R S . 

Then we have 

U S V S = V S U S = I, 
U S P = P S U S = P S R S P, 
PV S = V S P S = PR S P S . 



Lemma 2.1 We have 



7 1 /■ 

^o^^Ws) = J R((,A)BR((,A)d(. (22) 

If{PAP)(PB) = (PB)(PAP), then we have 



-^-\s=o{K lp sA s PsU s ) = PB. (23) 
as 

Proof. By the definition of U s and V s we have 

U^PsAsPsUs = V S P S P S U S = PR S P S A S P S R S P. 

By (|l|) we have 

{P s f{A s )P s - Pf(A)P)P = ^= J /(C)P(C, A)(A S P - AP)R((, A)dC (24) 
Since A s , s S (— e, e) is a curve in C(X), and im P has finite dimension, we have 
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±\ s=0 (P s f(A s )P s P) = —L=jf(C)R(C,A)BR(C,A)dC. (25) 

Take / = 1, we have Jj| s= oP s P exists. By the definition of R s we have ^\ s= qR s P = 0. Now 
formal calculation shows 

— \ S=0 (PR S P S A S P S R S P) = — -= / PR((,A)BR((,A)d(. 
ds 2tt\/— 1 j 7 

The assumption that im P has finite dimension shows the calculation is right. 
When (PAP)(PB) = (PB)(PAP), we have 



(PR S P S A S P S R S P) = — L= / PR((,A)R(t,A)Bd( 

Z7TV — 1 



j~U=0 

as 

= PB. 



P 2 B 



Q.E.D. 

By the above Lemma 2A, the proof of Theorem 4,1 in 24] also works for the following more 
general proposition. 

Proposition 2.1 Let I be a C 1 submanifold of R without boundary. Let A s , —e<s<e 
(e > 0),be a curve in Ai(X). Set P = Pi(Aq) and A = Aq Assume that im P C Y){A S ) and 
B = 4- | s= o A S P exists. Assume that 

(PAP)(PB) - (PB)(PAP) = 0, (26) 

where PAP,PB £ B(im P), and PB : im P — > im P is hyperbolic. Then there is a 5 £ (0, e) 
such that ui{A s ) = for all s G [—5, 0) U (0, 5] and 

sfi{A s , < s < 5} = -mT{PB : im P -> im P), (27) 
sf^A,, -<5 < s < 0} = m + (PB : im P -> im P). (28) 

Q.E.D. 

Now we consider two special cases. 

Lemma 2.2 Let X be a Hilbert space. Let A s ,—e<s<e be a curve of selfadjoint Fredholm 
operators with constant domain D such that A s < At for all —e < s < t < e. Assume that 
■^A s x exist for all s £ (— e, e), x G D, or A s is bounded for all s G (— e, e). Then for s < with 
\s\ small, dimckeryl s is constant and A s has no positive small eigenvalue. For s > small, 
dime ker A s is constant and A s has no negative eigenvalue whose absolute value is small. 

Proof. Firstly assume that j^A s x exist for all s G (— e,e), x G D. Let Ai(s) < ... < A&(s) 
be the spectral lines of A s for |s| small such that Ai(0) = . . . = Afc(0) = 0. Fix j = 1, . . . k and t 
with \t\ small. Pick x(s) G ker(^4 s — Xj(s)L) such that ||x s || = 1. Then every subsequence of x s , 
s — * t has a convergent subsequence. Let s n be the subsequence of s, s — ► t such that 

/x - r Ai (s) — A,- (i) ,. A,-(s n ) — A,(t) 
a,-(t) = liminf ^ = lim JV ; ^ 

s^i S — t n-^oo S n — t 
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and lim^^oo x(s n ) — ► x. Then x G ker(A t — Aj (£)/). So we have 

■(ac(s n ),a;) 
x, x(s n ) 



lim 

n— »oo 


Xj(s n ) 






- 1 


lim 

n— >oo 








- t 


lim 

n— >oo 




-A t )x 


V s n 


- t 






x^j 


0. 







> o 

Hence Xj(s) < \j(t) for s < t and \s\, \t\ small, and our results follows. 

Now assume that A s is bounded. For t > small, consider the curve Aq + (t — s)(At — A s ), 
< s < t. By the above arguments, At has no negative eigenvalue near 0. Q.E.D. 



By Lemmas 2.3 below, |2.2| and the definition of the spectral flow we have 



Proposition 2.2 Let X be a Hilbert space. 

(1) Let A s , < s < 1 be a curve of self adjoint Fredholm operators with constant domain D 
such that A s < At for all < s < t < 1. Assume that jfA s x exist for all s£ [0,1], x & D, or 
A s is bounded for all s G [0, 1]. Then we have 

sf {A s } = V (dimckerA^ - lim dim c ker^ ) > 0. (29) 
0<s<l V ' 

(2) Let A G C(X) be a selfadjoint operator with compact resolvant and B s G B{X), < s < 1 
be a curve of selfadjoint operators such that B s < Bt for all < s < t < 1. T/ien we have 



si{A + B s }= J2 ( dim c ker(A + £ s ) - lim_ dim c ker(A + B t ) )> 0. (30) 

0<s<l 



t->S~ 



Q.E.D. 

Similarly we have 

Proposition 2.3 Let X be a Hilbert space and I = (1 — e, 1 + e) (e > small). Let A s G S(-X"), 
< s < 1 6e a curve of unitary operators. Assume that A s — L is Fredholm and \ / —lAj 1 A s < 
for all s G [0, 1] . Then we have 

sf l {A s }= V (dime hsr(A s - 1) - lim dim c ker(A t - I) ) > 0. (31) 
0<s<l V J 

Q.E.D. 
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2.3 Spectral flow for curves of quadratic forms 

The spectral flow for curves of selfadjoint Fredholm operators has some special properties as 
finite dimensional case. 

The following lemma is Corollary 2.2 of [p4|. 



Lemma 2.3 Let X be a Hilbert space. Let A be a selfadjoint Fredholm operator on X with 
compact resolvent, and B be a bounded selfadjoint operator on X. Set K = (||j4|| + I) ■ Then 
we have 

L(AK, AK + KB] = I(A, A + B), (32) 

where AK, AK + KB are linear operators defined on the Hilbert space V = D(\A\^) with graph 
norm 

\\ X \\y = {\\\A\^X\\ 2 X + \\ X \\ 2 X )^. 

Q.E.D. 

Lemma 2.4 Let X be a Hilbert space. Let A s , < s < 1 be a curve of closed selfadjoint 
Fredholm operators. Then for any curve P s G B(X) of invertible operators, we have 

sf{P s P*A s } = sf{P;A s P s } = sf{A s }. (33) 

Proof. Since A s is a curve of closed selfadjoint Fredholm operators and P s is a curve of 
bounded invertible operators, the family P*A S P S , < s < 1, is a curve of closed selfadjoint 
Fredholm operators. By the definition of the spectral flow we have 

sf{P s P:A s } = sf {Ps^A^P- 1 } 

= sf{P s M s P s }. (34) 

Since P*AtP s are selfadjoint Fredholm operators and dime ker(P*A^P s ) = dimcker^, we 
have 

S f{p:A s p s } = S f{p *A s p } +sf {p;^ip s } 

= sf{P M s P } 

= sfiPfAsPi}. (35) 
Let Q s be curves of bounded positive operators on X satisfying Qq = I, Q\ = PoPq*. By 



(34) and fl3q) we have 



sf{P*A s P s } = sf{P*AP } 
= sf{P P *A s } 
= sf{Qi^ s Qi} 
= sf{Q A s Q } 
= sf{A s }. 

Q.E.D. 

The above lemma leads the following definition. 
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Definition 2.2 Let X be a Hilbert space. Let I s , < s < 1 be a family of quadratic forms. 
Assume that I s (x,y) = (A s x,y) for all x,y G X, where A s is a curve of bounded selfadjoint 
Fredholm operators. 

(1) The spectral flow sf{Z s } ofX s is defined to be the spectral flow sf{vl s }. 

(2) If A\ — Aq G CC(X), the relative Morse index I(1q,1i) is defined to be the relative 
Morse index I(Aq, A\). 

Based on this observation we can prove the following lemma. 

Lemma 2.5 Let X be a Hilbert space. Let A s G B{X), < s < 1 be a curve of selfadjoint 
Fredholm operators and I s be quadratic forms defined by I s (x,y) = (A s x,y) for all x,y G X. 
Assume that P s G B{X), < s < 1 is a curve of operators such that P^ = P s and I s (x,y) = 
for all x G im P s , y G im Q s , where Q s = I — P s . 

sf{T s } = sf{T s | im p s } + sf{2" s | im Q s }. (36) 
Proof. Let R s = P*P S + Q* S Q S . Since P s + Q s = I and P s 2 = J, we have 

r s = i ^ + 2( i --p:)( i --p s )>o. 

So R~ 1 A S are Fredholm operators. Now consider the new inner product (R s X,y), x,y G X on 
X. For this inner product P s is an orthogonal projection. Let B s G B(im P) and C s G Z3(im Q s ) 
satisfy I s (x,y) = (B s x,y) for all x,y G im P s and I s (x,y) = (C s x,y) for all x,y G im Q s 
respectively. By the fact that im P s and im Q s are T s -orthogonal, we have 

(A s x,y) = (R s (B s ®C s )x,y), Vx,y e X. 

So Rj^^Ag = B s © C s , and B s , C s are Fredholm operators. By Lemma [2.4| and the definition of 
the spectral flow we have 

sf{J s } = sf^; 1 ^} 

= sf{B s } + sf{C fl } 

= Sf { l s | im Ps } + Sf {2 S | im Q s } . 

Q.E.D. 

Remark 2.1 Here we allow the Hilbert space im P s continuous varying. By Lemma 1.4-10 in 
pty, for t G [0, 1] being close enough to s, there are invertible operators U s j G B{X) such that 

P t U s ,t = U Sjt P s , U s>t -> I, as t s. 

So locally we can define the spectral flow of B t as that of U~ t B t U St t : im P s — > im i-* s (s fixed), 
and globally add them up. 
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Lemma 2.6 Let X be a Hilbert space, and M be a closed subspace with finite codimension. Let 
A G B(M) be a selfadjoint Fredholm operator and I(x,y) = (Ax,y) for all x,y G M. Let Nq 
and Ni be subspace of X such that X = M © Nq = M © N\ . Define Z& on X, k = 0, 1 by 

Ik(x + u,y + v) = (Ax, y), Vx, y G M, Vu, t> G iVfc. 
T/ien we /iai>e L(Iq,I\) = 0. 

Proof. Without loss of generality, we assume that iVo is the orthogonal complement of 
M. Set A = diag(A, 0). Let B : Ni — > iV be a linear isomorphism. Define Pi G by 
P^x + y ) = x + By for all x G M, y E N±. Set Ai = P* A Pi- Then P x is invertible, Pi - I is 
compact, and Xk(x,y) = (AkX,y) for all x,y £ X and A; = 0, 1. Let P s G B(X), < s < 1 be a 
curve of invertible operators such that Pq = I and P s — L are compact. By the definition of the 
spectral flow we have 

L(l ,li) = I{Av,A x ) 

= -sf {p;a p s ) 

= 0. 

Q.E.D. 

The following proposition gives a generalization of Proposition 5.3 in [|| and a formula of 
M. Morse. 

Proposition 2.4 Let X be a Hilbert space and A G B(X) be a selfadjoint Fredholm operator. 
Let P be an orthogonal projection such that ker P is of finite dimensional. Let 2 be quadratic 
form on X defined by I(x,y) = (Ax,y), x,y G X. Set M = im P and N be the Z-orthogonal 
complement of M: N = {x G X;X(x,y) = 0, Vy G M}. Then we have 

L(PAP, A) = m~{l\ N ) + dime ker^ - dim c ker J. (37) 

Proof. Since PAP — A is a finite rank operator, sPAP + (1 — s)A are selfadjoint Fredholm 
operators. We divide our proof into three steps. 

Step 1. Equation (|7|) holds when ker A = and N C M. 

In this case, set M$ = kerZ|jvf, M\ be the orthogonal complement of Mq in M, and Po, Pi be 
the orthogonal projection onto Mo, M\ respectively. Then Po is of finite rank and P = Po + Pi. 
Let Ni be the Z-orthogonal complement of Mi. Since T\m 1 is nondegenrate, M\ n N\ = {0}. 
Moreover we have 

dim c iVi = dim c ker(APi) - ind(APi) 
= dime ker Pi — indA — indPi 
= dime ker Pi < oo. 

So X = M\ © Ni. By the fact that X is nondegenrate, X\n 1 is nondegenrate. Clearly Mq C Ni 
and Mq is the X| -orthogonal complement of Mq. N x has an orthogonal decomposition N x = 
N + © N~ such that N + and N~ is Z-orthogonal, 1\ N + > and 1\ N - < 0. Let P ± be the 
orthogonal projection onto A r=t . Then P |jwq is isomorphism. So we have 
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dime Ni = 2 dim c M = 2mT (J| 



Let Ti be defined by I\(x + u,y + v) = T(x, y) for all x, y G Mi, u, t> G iVi. By Lemma 2.5 and 



2.6 we have 



/(PAP, A) = I(PAP,P 1 AP 1 ) + I(P L AP 1 ,A) 

= I(P 1 AP 1 ,A) 

= I(Zi\mi,Z\mi) + I(Zi\ni>Z\ni) 

= m~(l\ Nl ) 

= dime ker Mq . 



Step 2. Equation © holds if M + N = X. 
In this case we have 

kerXljv = kerX = M n N. 

Firstly we assume that ker A = {0}. Then M nN = {0}. Let I± be defined by I±(x + u, y + 
v) = T(x, y) for all x, y G M, u,v £ N. By Lemma ^13 and |2.6| we have 



I (PAP, A) = I(Z U Z) 

= I{Ii\m),Z\m) + I(Zi\n),Z\n) 
= m~(l\ N ). 

In the general case, we apply the above special case by taking quotient space with ker A and 
get I(PAP,A) = m-{l\ N ). 

Step3. Equation (j37|) holds. 

Firstly we assume that keryl = {0}. Let Q be the orthogonal projection onto M + N. Then 
the T-orthogonal complement is kerc(2^|jv)- By the above two steps we have 



I (PAP, A) = I(PAP,QAQ)+I(QAQ,A) 
= m~(T\]y) + dime ker I\n- 

In the general case, we apply the above special case by taking quotient space with ker A and 
get (H). Q.E.D. 
At the end of this subsection we gives the following formula which will be used below. 

Lemma 2.7 Let X be a Hilbert space and A s G C(X), < s < 1 be a curve of Fredholm 

( A* \ 

operators. Let H = X © X and B s G C(H) be defined by B s = . s I . Then we have 



As . 

sf {B s } = dime ker Ai — dime ker Aq. (38) 
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Proof. Note that for A G R, A G cr(B s ) if and only if A 2 G a (A* A), and the algebraic 
multiplicity of them are the same if |A| / is small. Moreover we have 

dime ker B s = dime ker A s + dime ker A* 
indyl s = ind^o = dime ker A s — dime ker A* . 

By the definition of the spectral flow we have 

sf{-B s } = i (dime ker B± — dime ker Bo)) 
= dime ker A\ — dime ker Aq . 

Q.E.D. 

3 Maslov-type index theory 
3.1 Introduction to Maslov index 

We begin with the definition of the Lagrangian Grassmannian of a symplectic Hilbert space. 

Definition 3.1 Let X be a Hilbert space. Let j G B(X) be an invertible skew self adjoint op- 
erator. Set uj(x,y) = (jx,y) for all x,y G X. The form uj is called the (strong) symplectic 
structure on X, and the space (X, uj) is called symplectic Hilbert space. The linear sym- 
plectic group Sp(X,uj) is defined to be 

Sp(X,u) = {M G B(X); M*jM = j}. 

Let (Xi,ijJi), I = 1,2 be two symplectic Hilbert spaces. The space of linear symplectic maps 
Sp(Xl,X2) is defined to be 

Sp(X 1 ,X 2 ) = {MG B(X 1 ,X 2 );u 2 (Mx,My) =u 1 {x,y)}. 

Set A = (— j 2 )5 and J = A~ 1 j. Then (Ax,y), x,y G X is an equivalent Hermitian metric on 
X and J is a complex structure on X compatible with uj, i.e., J 2 = — / and lo(x, Jy) = (Ax,y), 
x, y G X is an equivalent Hermitian metric. All such J forms a contractable space. So we can 
replace the original metric on X with A. 

Definition 3.2 Let (X,uj) be a symplectic Hilbert space. 

(1) For any subspace A of X, the symplectic complement A" is defined to be 

A w = {y G X;u(x,y) = 0, Vx G A}. 

(2) A subspace A. of X is called Lagrange if = A. The Lagrangian Grassmannian 

C(X,uj) consists of all the Lagrange subspaces of (X,lu). 

(3) Let A, A G C(X,lu) be two Lagrange subspace. The pair (A, A ) is called a Fredholm 
pair if A n A is of finite dimension and A + A is a finite codimensional subspace of X . The 
Fredholm Lagrangian Grassmannian TCa(X,u) consists of all the Lagrange subspace A 
of X such that (A, A ) is a Fredholm pair. 
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The following lemma is well-known. 

Lemma 3.1 Let (X,uj) be a symplectic Hilbert space. Assume that there is an invertible skew 
selfadjoint operator J G B(X) such that J 2 = —I and u>(x,y) = (Jx,y). Let X\ = ker(J— \f— II) 
and X2 = ker(J + y/— II). Let Aq, A are two subspaces of X. Then we have 

(1) A G C(X, uj) if and only if there is an linear isometric U G U(Xi,X 2 ) such that A is the 

graph of Gt(U) ofU, where U(A~i, X 2 ) denotes the set of linear isometric between X\ and 
X2, U(X) denotes the unitary group of X and Gr(f7) denotes the graph of U . Specially, 
£(X,u) ^ if and only if\J(X 1 ,X 2 ) ± 0. 

(2) Let U,U' G U(Xi,X 2 ). Set A = Gv(U), A' = Gr(U'). Then (A, A') is a Fredholm pair if 

and only ifU — U is Fredholm. 

Q.E.D. 

Following []|] we give the following definition. 

Definition 3.3 Let (X,lo) be a symplectic Hilbert space. Assume that there is an invertible skew 
selfadjoint operator J G B(X) such that J 2 = —I and u{x,y) = (Jx,y). Let Xi = ker(J—\/—H) 
and X2 = ker(J + y/—\I). Let (A(s),A (s)), a < s < b be a curve of Fredholm pairs of Lagrange 
subspaces of X such that A(s) = Gt(U(s)), A'(s) = Gv(U'(s)), where U(s),U'(s) G \J(X 1 ,X 2 ). 
Let I = (1 — e, 1 + e) C C, be a interval on R, where e > is small. The coorientation of I is 
defined to be from the down half complex plane to the up half complex plane. The Maslov index 
z(A, A ) is defined to be the spectral flow — sf;{[/(s) ~ 1 U(s)}. It is independent of the compatible 
complex structure J. 

To calculate the Maslov indices, the standard method is the crossing form (cf. Q and |l9[| ). 
Let A(s), a < s < b be a curve of Lagrange subspaces of X. Let W be a fixed Lagrangian 

complement of A(t). For v G A(t) and \s — t\ small, define w(s) G W by v + w(s) G A(s). The 

form 

Q(A, t) = Q(A, W, t)(u, v) = —\ s=t uj(u, w(s)), V-u, v G A(t) 

as 

is independent of the choice of W. Let (A(s), A'(s)), a < s < b be a curve of Fredholm pairs of 
Lagrange subspaces of X. For t G [a, b], the crossing form T(A, A , t) is defined on A(t) fl A (t) 
by 

r(A, A',t)(u,v) = Q(A,t)(u,v) - Q(A' ,t)(u,v), Vu,v G A(t)nA'(t). 

A crossing is a time t G [a, b] such that A(i) n A' (t) ^ {0}. A crossing is called regular if 
r(A, A ,t) is nondegenerate. It is called simple if in addition A(t) Pi A (t) is one dimensional. 

Now let (X,u) be a symplectic Hilbert space with u(x,y) = (jx,y), x,y G X, j G B(X) 
and j* = —j. Then we have a symplectic Hilbert space (H = X © X, (—uj) © uj). For any 
M G Sp(X,u), its graph Gr(M) is a Lagrange subspace of H. The following lemma is Lemma 
3.1 in g. 

Lemma 3.2 Let M(s) G Sp(A, uj), a < s <b be a curve of linear symplectic maps. Assume that 
M(s) is differentiable at t G [a,b]. Set Bi(t) = -jM(t)M(t)' 1 and B 2 (t) = - j M (t)' 1 M (t) . 
Then B^t), B 2 (t) are selfadjoint, B 2 (t) = M{t)*B 1 {t)M{t) and we have 

Q(Gv(M),t)((x, M(t)x), (y, M(t)y)) = (B 2 (t)x, y). (39) 
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Q.E.D. 

Corollary 3.1 Let (X,uj) be a symplectic Hilbert space and (A(i),A (t)), a < t < b be a C 1 
curve of Fredholm pairs of Lagrange subspaces of X with only regular crossing. Then we have 

i(A,A') =m + (r(A,A',a))-m-(r(A,A',6))+ ^ sign(r(A, A', *)). (40) 

a<t<b 

Proof. Pick an invertible skew selfadjoint operator J G B(X) such that J 2 = —I and 
u>(x, y) = (Jx, y). Let X\ = ker( J — yf—lT) and X 2 = ker( J + y/—\T). By Lemma [O] there are 
curves of isometric U(t), if (t) in \J(X 1 ,X 2 ) such that A(t) = Gr(Z7(t)) and A'(t) = Gr(C/'(i)). 
Apply Lemma |3.2| for X\ with j = — yj— II, for any x,y G ker([/(t) — f7 (i)) and i G [a, 6] we 
have 

^- s \ s =t{-^lU'- l Ux,y) = (-jU'- 1 UU'- 1 Ux,y) + (jU'- 1 Ux,y) 

= {-jU^Ux, y) + {U'- l UjU- l Ux, u'' x Uy) 
= (-jU'- 1 U'x,y) + (jU~ 1 Ux,y) 
= -T(A,A',t)((x,Ux),(y,Uy)). 

By Proposition [D] we obtain (||). Q.E.D. 
By Proposition [2.3| , Lemma |3.2| and the proof of Corollary 3.1 we have 

Corollary 3.2 Let (X,uj) be a symplectic Hilbert space and M{s) G Sp(X,u>) ! a < s < b be a 
C 1 curve of linear symplectic maps. Assume that —jM{i)M(t)~ l is semi-positive definite. Let 
H = {X ® X, (— oS) © lo) and W be a Lagrange subspace of X. Then we have 

i w (M{t))= (dim c (Gr(M(s))n WO - lim dim c (Gr(M(t)) fW)) > 0. (41) 



0<s<l 



Q.E.D. 

Corollary 3.3 ('Symplectic invariance ) Let (Xi,uii), I = 1,2 be two symplectic Hilbert spaces, 
and M{t) G Sp(.Xi, X2), a < t < b be a curve of linear symplectic maps, and (A(t),A (t)), 
a < t < b be a curve of Fredholm pairs of Lagrange subspaces of X\ . Then we have 

i(MA,MA') = »(A,A'). (42) 

Proof. Firstly assume that the curves M, A, A are differentiable and the pairs (A, A ) have 
only regular crossing. By the definition of the crossing form, for any t G [a, b] we have 

T(MA,MA' ,t)(M(t)u,M(t)v) = F(A, A', t)(u,v) Vu,v G A(t) D A'(t). 



By Corollary |3.1| , equation ( |42| ) holds. For the general case, we can make a small perturbation of 
the curves M, A, A with their endpoints fixed such that they satisfy the above condition. Then 
our result follows from the homotopy invariance rel. endpoints of the Maslov indices. Q.E.D. 
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3.2 The spectral flow formula and Maslov-type indices 

Let A be a closed densely defined symmetric operator on a Hilbert space H with domain D 
Let Dm be the domain of A*. Define the inner product on Dm by 



(x,y) = (x,y) + (A*x,A*y). 

Then Dm is a Hilbert space and D m is a closed subspace of Dm- The orthogonal complement 
of D m in Dm is ker(^4* 2 + /). Define X = DM/D m and let 7 : Dm — ► X be the canonical map. 
The map 7 is called the abstract trace map. Define to : X x X — > C by 

^(tO), 7(2/)) = O 4 *^, v) - ( x , A *v)i V;c > y£D M . 

Then (X, uj) is a symplectic Hilbert space. 

The following proposition is Theorem 5.1 in ||. 

Proposition 3.1 (Spectral flow formula) Let A be a closed densely defined symmetric operator 
on a Hilbert space H with domain D m and let Ct,t £ [a, b] be bounded. We assume that 

1. A has a selfadjoint extension Ar> with compact resolvent, where D is the domain of A. 

2. there exists a positive constant a such that D m n kei(A* + Ct + s) = {0} for any \s\ < a 
and any t £ [a, b]. 

Then we have 



sf{A D + C t } = -i( 7 0D),7(ker(A* + C t ))). (43) 

Sketch of the proof. Here we only consider the case that Ct is of class C . The condition 
shows that (7(D), {7(ker(A* + Ct)}) is a C 1 Fredholm pairs of Lagrange subspaces of X. Let 
x, y £ ker(^4* + Ct)- Pick a Lagrange complement W of 7(ker(^4* + Ct)). Then for s with \s — t\ 
small, W is also a Lagrange complement of 7(ker(^4* + C s )) and there is y s € ker(^4* + C s ) such 
that y s — > y when s — > t. So we have 

u(~f(x)n{ys ~y)) = (A*x,y s - y) - (x,A*(y s - y) 

= (~C t x, y s -y) - (x, -C s y s + C t y) 
= ((C s -C t )x,y s ). 

Differential it with respect to s at s = t, we get 



Q( 7 (ker(A* + C s )),t) = QtCtQt 



(44) 



where Qt is the orthogonal projection from H onto ~ker(A* + Ct). 

By Theorem 4.22 in pi], we can choose 5 S (0, a) sufficiently small such that ker(^4 + Ct + 
si) = {0} for t = a or b and s G (0, 5], and Ap + Ct+dl has only regular crossing. By Proposition 
O, Corollary [D] and (p]) we have 



si{A D + C t } = sf{A D + C t + 5I} 

= -m-(P a C a P a )+m + (P b C b P b )+ sign(PtCtPt) 

a<t<b 
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= -m + {j(D),T{-f(kev(A* + C a + 5I)),a) 
+m-(j(D), r( 7 (ker(^* + C s + 51)), b) 
- Y, sign(7(£>),r(7(kex(A* + C s + W)),t) 

a<t<b 

= -i( 7 (Z)),7(ker( J 4* + C s + ( 5/))) 
= -*( 7 (Z)),7(ker(A* + C7 t ))), 

where Pj is the orthogonal projection from onto ker(A/) + Cj). Q.E.D. 
Now we turn to the Maslov-type indices. 

Definition 3.4 Let (Xi,u>i) be symplectic Hilbert spaces with ui(x,y) = (jix,y), x,y £ Xi, 
ji £ B(X) are invertible, and j* = —ji, where I = 1,2. Then we have a symplectic Hilbert space 
(H = Xi © X 2 , (-wi) to 2 ). Let W £ C{H). Let M(t), a < t < b be a curve in Sp(Xi,X 2 ) 
such that Gr(M(i)) £ J~C(W) for all t £ [a,b]. The Maslov-type index iw(M(t)) is defined 
to be i(Gr(M(t),W). If a = 0, b = T, = (X 2 ,lo 2 ) and M(0) = I, we denote by 

u TjW (M(t)) = dime (Gr (M(T) n HQ. 

The Maslov-type indices have the following property. 

Lemma 3.3 Let (Xi,ui) be symplectic Hilbert spaces with u>i(x,y) = (jix,y), where x,y £ X\, 
ji £ B(Xi) are invertible, and j\ = —ji, I = 1,2,3,4. Let W be a Lagrange subspace of 
{X\ © -X4, (— u>i) © CJ4). Let 7/ £ C([0, 1], Sp(X/, Xi+%)), I = 1,2,3 be syplectic paths such 
that Gr( 73 (s) 7 2(£) 7 i(s)) £ TC{W) for all (s,t) £ [0, 1] x [0, 1]. Then we have 

%(73727i) = iw'M + ^(7372(0)71), (45) 
where W' = diag( 7 i(l), 73(1) _1 )VF. 

Proof. Let M = diag( 7 x(l), 73(1) _1 ). By the homotopy invariance rel. endpoints of the 
Maslov-type indices and Corollary |3l| we have 



^(737271) = iw (73 (1)7271(1)) + *w (7372(0)71) 

= i(MGr(7 3 (l)7 27l (l)), MW) + i w (7372 (0)71) 

= V'(72) + *w(7372(0)7i )• 

Q.E.D. 

The following properties of fundamental solutions for linear ODE will be used later. 

Lemma 3.4 Let j £ C 1 ([0, +00), Gl(m, C)) be a curve of skew selfadjoint matrices, and b £ 
C([0, +00), gl(m, C)) be a curve of selfadjoint matrices. Let 7 £ C 1 ([0, +00), Gl(m, C)) be the 
fundamental solution of 



jx — -jx = bx. (46) 



Then we have l(t)*j(t)'y(t) = j(0) for all t. 
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Proof. By the definition of the fundamental solution, we have j(0)*j(0)j(0) = j(0). Since 
j* = —j and b* = b, we have 



^(7(*)*j(*h(*)) = 7*i7 + 1*31 + 1*31 

= (~ b l ~ -^3ff~ X 31 + 7*J7 + 7*JJ~ 1 (-&7 - ^j) 

1 - 1 ■ 

= l*(b~ ^3+3 ~ b- -j)l 

= 0. 

So we have l(t)*j(t)~f(t) = j(0). Q.E.D. 

Lemma 3.5 Let B G C([0, +oo), gl(m, C)) and P G C 1 ([0, +oo), Gl(m, C)) be two curves of 
matrices. Let 7 G C 1 ([0, +00), Gl(m, C)) be the fundamental solution of 

x = Bx, (47) 
and 7' G C 1 ([0, +00), Gl(m, C)) be the fundamental solution of 

y = (PBP- 1 + PP~ l )y. (48) 

Then we have 

7' = P 7 P(0)- 1 . (49) 

Proof. Direct calculation shows 

— (PjPiO)- 1 ) = (PBP- 1 + PP- 1 )P 7 P(0)~ 1 
at 

and P(0)7P(0)" 1 = I. By definition, P7P(CfT 1 is the fundamental solution of (||). Q.E.D. 

Corollary 3.4 Let j\,j2 G C 1 ([0, +cxd), Gl(m, C)) be two curves of skew selfadjoint matri- 
ces. Let P G C 1 ([0, +00), Gl(m, C)) be a curve of matrices such that P*j2P = ji, o,nd b G 
C([0, +00), Gl(m, C)) be a curve of selfadjoint matrices. Let 7 G C^QO, +00), Gl(m, C)) be the 
fundamental solution of 

- 3ix - ~jix = bx, (50) 
and 7' G C 1 ([0, +00), Gl(m, C)) be the fundamental solution of 

32y-\j2y = (P*- l bP- 1 + Q)y, (51) 
where Q = \{P*~ 1 P*32 - j 2 PP~ 1 )- Then we have 

7 '=P 7 P(0)- 1 . (52) 
In particular, when j\ and 32 are constant matrices, we have 

Q = P*~ l P*j2 = -32PP- 1 . 
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Proof. Take B = —j l 1 (b + ^ji) in Lemma we have 



-32{pbp- 1 + Pp- 1 ) - x -h = -UPi-hY 1 ^ + l^P' 1 + pp- 1 ) - \h 

= p*-\b+~j 1 )p- 1 -j 2 pp- 1 -~j 2 



p^bp- 1 - hpp- 1 + I(p*- 1 A(p* i2 p ) p-l _ /2) 

p*-l hp -l + g 



By Lemma 3.5, our results holds. Q.E.D. 
The following is a special case of the spectral flow formula. 

Let j G C 1 ([0, T], Gl(m, C)) be a curve of skew selfadjoint matrices. Then we have symplectic 
Hilbert spaces (C m ,uj(t)) with standard Hermitian inner product and u(t)(x,y) = (j(t)x,y), for 
all x, y G C m and t G [0, T]. Then we have a symplectic Hilbert space (V = C m ©C m , (-w(O))© 
w(T)). Let W G £(F). Let 6 s (i) G £(C m ), < s < 1, < t < T be a continuous family of 



selfadjoint matrices such that bo(t) = 0. By Lemma 3^, there are continuous family of matrices 
M s (t) G Gl(m, C) such that M a (0) = I and 

-3jM s (€) - l -{j t j)M s (t) = b,(t)M,(t). 

Set 

X = L 2 ([0,T],C m ), £) m = if o 1 ([0 ! T],C m ), 
Dm = ^(M.CT), % = { a; e%(x(0) )3 ;(t))ef}. 

Let Am G C(X) with domain L>m be defined by 

d 1 d 

Amx = —i—x ( — i)x. 

J dt 2 y dt J> 

Set x G D M , A = A M \D m , A w = A M \ Dw . Let C s G B(X) be defined by (C s x)(t) = b s (t)x(t), 
x G X, t G [0,7]. 

Proposition 3.2 5ei = diag(J, Mq^-^W . Then we have 

I(A W ,A W - Ci) = V( M o _1 ^i)- (53) 

Proof. The Sobolev embedding theorem shows that Dm C C([0, T], C m ). For any x G -Dmj 
define 7(3;) = (x(0),x(T)). Direct calculation shows that DM/D m = C m © C m with symplectic 
structure (diag(j(0), — j(T)) r y(x), 7(3/)), x,y £ Dm, and 7 is the abstract trace map. Moreover, 



,4* = A M , 7(A* - C s ) = Gr(M s (T)), and -y(D w ) = W. By Proposition fU\ and Lemma gj, we 
have 
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I(A W ,A W -C X ) = -si{A w -C s } 

= t({M s (T);0 < s < 1},W) 

= i H /(Mo(T)(M (T)- 1 M s (T))/; < a < 1) 

= i wl {M {T)~ l M s (T)^<s<l) 

= -V(^o(t) -1 M (t);0< t < T) + i w * (M (0) _1 M s (0); < s < 1) 

+i w '{M (ty 1 M 1 (t);0<t<T) 
= i^iM^My). 

Q.E.D. 



4 Proof of the main results 

In this section we will use the notations in §1. Let R be a subspace of C 2n . Set H = 
L 2 ([0, T], C n ), where T > 0. Let Kr be a closed operator on H. Its domain is Hr defined 
by (|Tl|), and i/ijx = x for all x G -fffj. Set 

X = L 2 ([0,T],C 2 ™), ZV(i?) = {x E ^(M-C 2 "); (x(0),x(t)) G ^(i?)}. 

For any x,y G iI 1 ([0,T], C 2n ), define 

= (x,y) + (x,y). 

Let Ayytm G C(X) with domain D w ^ be defined by ^I^^rax = —J-^x, x G Z)^(_r)- Let 
C s G be defined by (C s x)(t) = b s (t)x(t), x G X, t G [0,T]. Then we have ITfc = -K Rb . 

Consider the standard orthogonal decomposition 

c 2n = (c n x {o})e({o} x c n ). 

It induces orthogonal decompositions X = H © H and -Dvk(R) = H R b © -Hr. Under such 
orthogonal decompositions, A w r R \ is in block form A w r R \ = ( ® fl ]. Let b s (t),C s be in 
block form 

hi(s,t) b 12 (s,t)\ 
b 2 i(s,t) b 22 (s,t)J 
r fCn(s) C 12 (s)\ 

\C 21 (s) C 22 (s)J- 

Define P S ,Q S , R s £ B(H R ) by 

(P,s,y)i = {C n {s)- l K R x,K R y), 
(Q s x,y)i = -(Cii(s)~ 1 Ci 2 (s)x,K R y), 
(12.z,y)i = ((CaiWCJnW^CiaW-aaW^y) 
for all x, y G H^. Then the index forms T s defined by (|l^) satisfy 

Z s (x,y) = ((P a + Q a + Q; + /2 a )x,y)i. 
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Lemma 4.1 The operator P s + Q s + Q* + R s G B(Hr) is a curve of Fredholm self adjoint 
operators. 

Proof. Since 2 S are bounded symmetric quadratic forms on Hr, by Riesz representation 
theorem, P s + Q s + Q* + R s G B(Hr). Similarly we can see that they form a continuous curve. 

Let Q s = —C\i{s)~ 1 Ci2{s) and R s = C2i(s)Cn(s)~ 1 Ci2(s) — C22(s) be two bounded op- 
erators on H. Then Q* s = {K* R K R + I)- x Q'*Kr and R s = {K* R K R + J) -1 i£. So Q* and R s 
maps bounded subset of Hr into the bounded subset in the domain G(K r Kr) of K* r Kr. Since 
D(Er^i^/j) is a closed subspace of H 2 ([0, T], C n ), by Sobolev embedding theorem, the embedding 
of ~D(K r Kr) into Hr is compact. So Q*, Q s , and i? s are compact. 

Now we prove that P s is Fredholm and then our lemma is proved. If p s (t) is positive definite, 
we can choose q s (t) = and a positive definite curve r s (t) such that P s + i? s is positive definite. 
So P s + R s is invertible. Since R s is compact, P s is Fredholm. Here it is only required that 
p s (t) continuous. In the general case, we have to assume that p s (t) is C 1 in t. Note that 
H C 2n = -fT 1 ([0, T], C n ). Consider the operator p s : H C 2n — > H C 2n. Let j : Hr — > .£f C 2n be the 
injection. Then p s is invertible and p s j is Fredholm. For any x G -fffj and y = i? C 2n , the inner 
product ((P s — p s )x,y)x consists only the lower-order terms (i.e., no second-order differential 
involved) and some boundary terms. Similar to the above proof, we can conclude that the 
lower-order terms correspond to compact operators. The boundary terms correspond to finite 
rank operators. So jP s —Psj is compact. Since p s j and j are Fredholm, jP s and P s are Fredholm. 
Q.E.D. 

The following lemma is the key to the proof of Theorem LI . 
Lemma 4.2 Let ut, s (x) = {p s Krx + q s x,x) for all x G Hr and < s < 1. Then we have 

ker(A w ^ - C s ) = {ub 3 (x); x G ker J s }. (54) 
Moreover, for any x,y G we have 

Q.E.D. 

Proof. Since T s (x,y) = (p s Krx + q s x,KRy) + (q*KRX + r s x,y) for all x,y £ Hr, by the 
definition of i^, we have x G ker T s if and only if x G T)(K R ), and K^(p s if^x-|-g s x) + (g , *i^^x-|- 
r s x) = 0, if and only if Ub s (x) G ker(A W (R) — C s ). So equation (|54|) is proved. 

Now we turn to equation (|55|) . Set Z s = ( ^ ^ ^ • ^ ^he definition of 6 S and direct 
computation we have 

°). s). -*.*.-(* <«> 

So we have 



ds 



b, Z R 



ds 



{Z* s b s Z s 



+ Z*b s ^-Z s + Z*-^-(b s Z s 

s ds s ds v 











-J 



TsPs 



-J 
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■TsPs \_f-£ Ps -i s 1s\_(-i s Ps 



d 

ds \q* r s 
Hence for all x, y G Hr, we have 



o £r s ) \ o o ; v-^ 

Ps q s 



Now we can prove Theorem |L1 



„ T (Oh 

j_ f Ps Qs 
\C?S V<?s r s 



5 



eft 



Q.E.D. 



Proof of Theorem By Lemma [O], sf{Z s } is well-defined. Since the spectral flow is 

invariant under homotopy with endpoints fixed, by small perturbation which fixes the endpoint, 
we can assume that C s is a C curve. By Theorem 4.22 in |§ ; we can take a sufficient small 
5 > such that Cn(s) — 51 is invertible, — C s + 51, < s < 1 has only regular crossing, 

C s + al is invertible for s = 0, 1 and a G (0, 5]. Let Z S)0 be the correspondent index 



and A 



W{R) 



form of C s — al. By Proposition 2.f , Proposition |3.2j and Lemma 4.2 we have 



J(T ,Zi 



-sf{J s ,0 < s < 1} 

-sf{X s , 5 ,0<s<l} 

-sf{,4 VK(R) - C s + 51, < s < 1} 

-sf{^ (jR) -C s ,0< s <l} 

iw(R)(li) ~ iw(R)(lo)- 



Q.E.D. 



To prove Theorem 1.2, we need some preparations. 



Lemma 4.3 Theorem \l.3j holds in the following two cases: 

(i) R = C 2n , 

(ii) p G C([0, T], gl(n, C)) is a pa£/i of positive definite matrices, and P(t) = fQp(s)ds for all 

te[0,T]. 

Proof. By the definition of W(R) we have 

Gr( 7 (t)) n = {(z, y, x, y + P{t)x); (x, x) G R b , (y, y + P(i)z) G R}. 

In the case (i), we have R b = {0} and Gr( 7 (i)) n W(-R) = {(0, y, 0, y); y G C n } for all t G [0,T]. 
So we have i\v(R) (t) = an d Theorem [T^ holds. 
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Now we consider the case (ii). Since P(t) is positive definite for all t G (0, T], for all 
(x, y,x,y + P(t)x) G Gr(7(t)) n W(R), we have -(x, P(t)x) = ((x, -x), {y, y + P(t)x)) = and 
hence x = 0. So we have 



Gr( 7 (i)) n W(R) 



Gr{I)nW{R), if t = 0, 

{(0,y,0,j/);(j/,y) G i?}, iftG(0,T]. 



By Corollary 3.2 we have 



iw{R){l) = dim c (Gr(7(0))niy( J R))-dimc(Gr( 7 (r))nW( J R)) 

= dim c (Gr(/) n W{R)) - dim c (Gr(/) n R) 

= dim c (Gr(/) D R b ) 

= dime S. 



Q.E.D. 



Proposition 4.1 Let 7 G C([0, T], Sp(2n, C)) be such that 7 (0) = /. Let R\ C R2 be two linear 
subspaces ofC 2n . Define 

N = {(x, y, z, u) G Gr( 7 (T)); (x, z) G R\, (y, u) G R 2 }, 

and 

Q((x 1 ,yi,z 1 ,u 1 ), (x 2 ,y 2 ,z 2 ,u 2 )) = (z 1 ,u 2 ) - (xi,y 2 ) 
for all (xi, yi,Zi,u±), (x 2 ,y 2 , z 2 ,u 2 ) G M. Then Q is a quadratic form on N , and we have 

iw{R 2 ){l) - iw{ Rl ){l) = C(j(T);Ri,R 2 ) + dim c (Gr(/) n R\) - dim c (Gr(/) n R.\), (57) 
where 

C( 7 (T); R U R 2 ) = m-(Q) + dim c ker Q - dim c (Gr( 7 (T)) n W{R 2 )). 
We call C(j(T); Ri, R 2 ) the Morse concavity o/ 7 (T) with respect to R\,R 2 . 



Proof. By f22[| , there exist paths of matrices p,q,r G gl(n, C) such that are positive 
definite, r(t) = r(t)* for all t G [0,T], and 71 (T) = 7 (T) if p s = p, q s = sq, r s = sr for all 
s G [0,1], and 7s are the fundamental solution of (|l4|) . Let T s be defined by (|l2]) . By Theorem 
|1.1| and Lemma 4.3, we have 

m-(l 1 \ HRk ) = i w{Rk) ( 7l )-dim c (Gr(L)nR b k ), k = 1,2. (58) 
Let iV be the Ti-complement of H Rl in Hr 2 . Direct computation shows that 



Define ^ : iV — ► JV" by 



x G H R2 ;(u bl (x))(t) = 7 i(t)K(x))(0) for all t G [0,T] 
and (p(O)x(O) + 9(0)x(0),p(T)x(T) + q{T)x{T)) G fl$ 



V9(x) = (K(x))(0),K(x))(T)). 
Then 99 is a linear isomorphism. Direct computation shows that 

Zi(x,y) = Q{v{x),v{y)) 
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for all x,y G N. By Proposition 2.4 and Lemma 4.2 we have 

m~~(li\ Hlh ) - m~(l 1 \ HRl ) = m~(Ji|jv) + dime ker(Xi|iv) - dime ker(Ji|if Ka ) 

= m~(Q) + dime ker Q - dim c (Gr( 7l (T)) n W(R 2 )) 

= m~(Q) + dime ker Q- dim c (Gr( 7 (T)) rW(_R 2 )) 

= C( 1 (T);R 1 ,R 2 ). (59) 

By the fact that 7 and 71 has the same end points, we have 

*V(flx)(7) - *w(ai)(7l) = *V(Jfe)(7) - *w(Jfe)(7i)- 
By (|5q) and (p9|) , we have 

i W(iJ 2 )(7) - *w(Bi)(7) = *W(Jfa)(7i) - *W(Bi)(7l) 

= (m-^xlHKj + dimcCGr^ni?!)) 

-(m-(Ji|^ +dim c (Gr(J) ni^)) 

= C(7(T); i? 2 ) + dim c (Gr(J) n - dim c (Gr(/) n R\). 

Q.E.D. 

Proof of Theorem OL Firstly we assume that P(0) = 0. Set R\ = R and i? 2 = C 2n . 



Let Q, be defined by Proposition |4.l| . By the definition of J\f we have 

N = {(x, y, x, P(T)x + y); (x, x) E 

Define 99 : S x C n -► by 

tp(x, y) = (x, y, x, P(T)x + y). 

Then (p is a linear isomorphism. So we have dime A/" = dime S + n. By the definition of Q we 
have 

Q(ip(x 1 ,y 1 ),cp(x2,y2)) = (x 1 ,P(T)x 2 + y 2 ) - {x 1 ,y 2 ) 

= (P(T)xi,x 2 ). 

So we have m+(Q) = m + (P(T)\ s ). By the definition of C(j(T); R, C 2n ) we have 

C(j(T);R,C 2n ) = m-(Q) + dim c ker Q- dim c (Gr( 7 (T)) DW(R)) 
= dime M — m + (Q) — n 
= dime S-m+(P(T)\ s ). 



By Proposition [4.1| we have 

i W (R)(l) = *W(C*>)(7) " C( 7 (T);/J, C 2 ") - dim c (Gr(J) n (C 2 ") b ) + dim c (Gr(/) n E 6 ) 
= 0- (dim c 5-m + (P(T)| 5 )) - + dim c 5 
= m+(P(T)\ s ). 
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I CF 

Now we consider the general case. Define M t (s) = ( , , ) for all s G [0, 1] and t G [0, T]. 



Then M t (s) G Sp(2n, C), and we have 



sP(i) 



*W(fl)(7) = *vk(r)( m t) -%(fl)(M ) 

= m + (P(T)\ s )-m + (P(0)\s). 

Q.E.D. 

Now we prove Theorem 1.3. Let a, p 1 , q 1 , r 1 , b 1 , R be as in §1. Let C 1 be the corresponding 



bounded operator of C\. The following lemma follows from direct calculation. 
Lemma 4.4 We have 

&l = diag(a~ 1 ,a*)6 1 diag(a*" 1 ,a) + f^-i °o °) ' ( 61 ) 

Ar(fl') _C l = diag(a _1 ,a*)(A W ( fl ) - Ci)diag(a*~\ a), (62) 
a~ Krcl = K R i + a~ 1 d. (63) 

Q.E.D. 



By Corollary 3.4 we have 
Corollary 4.1 We have 

7 ; = diag(a\ a- 1 ) 7l diag(a(0)*- 1 , a(0)). (64) 



Lemma 4.5 Lei a G C([0, T], Gl(n, C)). Set 7 = diag(a*, a" 1 ). T/ien 7 G C([0, T], Sp(2n, C)), 
and we have 

iw(R)h) = dim c (Gr(a(0)- 1 )n J R)-dim c (Gr(a(r)- 1 )ni?) 

= dim c (Gr(a(0)*)n J R f, )-dim c (Gr(a(T)*)n J R 6 ). (65) 

Proof. Clearly we have 7 G C([0, T], Sp(2n, C)). We divide the proof into three steps. 
Step 1. o(0) = / and a G C 1 ([0, T], Gl(n, C)). 
In this case, set 

/ -a-'a\ 

{-^a*- 1 

Define C G B(X) by (Cu)(t) = c(t)u(t). Then 7, a -1 and a* are the fundamental solutions of 
u = Jcu, x = — a~ l ax and x = a*a*~ 1 x respectively. Since K* R = —K R b, we have 

dime ker(K R + a~ l a) = dirn c (Gr (a(T) _1 ) n R), 
dimcker^ + aV" 1 ) = dim c (Gr(a(T)*) n R b ). 
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By Proposition 3.2 and Lemma 2.7, we have 



iw(R)h) = I ( A W(R), A W(R) - C) 

= -si{A w(R) -sC;0<s<l} 

, r / —K R — sa~ 1 a\ n . , 1 , 

= - Sf{ [-K R - S a*a^ )^<s<l} 

= dime ker(iijj) — dime ker(K R + a~ a) 
= dime ker{K R ) - dim c ker(if£ + a* a*" 1 ) 
= dim c (Gr(/) n R) - dim c (Gr(a(T)- 1 ) n R) 
= dim c (Gr(I) D R b ) - dim c (Gr(a(r)*) n R b ). 

Step 2. a(0) = J. 

Since Gl(n, C) is a connected Lie group, there exists H s (t) G Gl(n, C) such that Ho(t) = a(t), 
Hi is smooth, H s (0) = I, and H S (T) = a(T) for all s G [0, 1], i G [0,T]. By Step 1 we have 

iw{R){l) = ^^(diag^ifr 1 )) 

= dim c (Gr(/) n R) - dim c (Gr(a(T)- 1 ) n R) 
= dim c (Gr(/) n R h ) - dim c (Gr(a(T)*) n R b ). 

Step 3. General case. 

Since Gl(n, C) is a connected Lie group, there exists a G C([0, T], Gl(n, C)) such that a(0) = 
/, a(T) = a(0). By Step 2 we have 

Hy(i?)(7) = (%( fl )(diag(a*,ar 1 )) +»w(fl)(7)) - «w/(fl)(diag(a*, a -1 )) 
= (dim c (Gr(/) n -R) - dim c (Gr (a(T)" 1 ) n J2)) 

-(dim c (Gr(/) n fl) - dim c (Gr(a(0)" 1 ) n R)) 
= dim c (Gr(a(0)" 1 ) n R) - dim c (Gr(a(T)- 1 ) n R) 
= dim c (Gr(a(0)) n R b ) - dim c (Gr(a(T)*) n R b ). 

Q.E.D. 



Proof of Theorem |1.3|. By Corollary 4.1, Lemma 3.3 and Lemma 4.5, we have 



V(r')(Tl) = V (i? ' ) (diag(a*,a" 1 )7idiag(a(0)*" 1 ,a(0))) 

= i\V(R)(rfl) + V(j?')( dia g( a *' a ~ 1 ) dia g( a (°)*~ 1 ' a (°)) _1 ) 

= iw(R)(li) + dim c (Gr(a(0)- 1 a(0)) D R) - dim c (Gr(a(T)- 1 a(0)) n R) 

= iw(R)(li) + dim c (Gr(/) n R') - dim c (Gr(/) n R). 



Q.E.D. 
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